Skip to content

[TORCH] Transformer encoder decomposition #4381

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

[TORCH] Transformer encoder decomposition #4381

wants to merge 1 commit into from
+690 −1

Conversation

@catcor01
Copy link

@catcor01 catcor01 commented Nov 19, 2025

  • Add a dedicated DecomposeTransformerEncoder pass to expand encoder ops into primitive Torch patterns.
  • Extend shared lowering helpers (ReduceOpVariants.cpp, Utils.h) so the new pass can reuse reduction utilities during decomposition.
  • Register the pass in the Torch Transform pipeline so it runs as part of the decomposition flow.
  • Expand e2e coverage with new transformer encoder tests to validate the lowering path.

Change-Id: I6bcda53569cf7b06df4cb97c624bbf512d8fecb7

@catcor01 catcor01 force-pushed the transformer_encoder branch 2 times, most recently from 2e95de5 to 0de7090 Compare November 26, 2025 09:29
@catcor01
[TORCH] Transformer encoder decomposition
e446682 
- Add a dedicated DecomposeTransformerEncoder pass to expand encoder ops into primitive Torch patterns.
- Extend shared lowering helpers (ReduceOpVariants.cpp, Utils.h)
  so the new pass can reuse reduction utilities during decomposition.
- Register the pass in the Torch Transform pipeline so it runs as part of the decomposition flow.
- Expand e2e coverage with new transformer encoder tests to validate the lowering path.

Signed-off-by: Cathal Corbett <[email protected]>
Change-Id: I6bcda53569cf7b06df4cb97c624bbf512d8fecb7
@catcor01 catcor01 force-pushed the transformer_encoder branch from 0de7090 to e446682 Compare November 26, 2025 09:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@catcor01